CS 5262-0

Brief

This course consists of two parts. In the first half, we will review the main concept of the broad area of multimedia and networking system. This is to make sure that all the students are ready to get into the second part, in which they will study one of the cutting-edge multimedia networking system, such as 360-degree video streaming to head-mounted display, decentralized social media, and P4 ba<x>sed Media-Aware Network Elements. The goal is to have each student finish a research project/report at the end of the semester.

Description

Course keywords: Multimedia Content Preparation, Content Delivery, High-Dynamic-Range (HDR) Videos, Networked Games, Virtual/Augmented/Mixed Reality, 3D Video, Immersive Systems, Light-Field Video, 360° Video, Volumetric Video Delivery, Multimedia IoT, Mobile Multimedia, Wearable Multimedia, Peer-to-Peer (P2P), Cloud ba<x>sed Multimedia, Multi-Sensory Experiences, Quality-of-Experience (QoE) 1. 課程說明(Course Description) This course covers the latest research in the areas of networking and multimedia systems. Despite the basic concepts of multimedia networking will be reviewed, the course is a graduate-level course and requires each student to work on an intensive term project. Students are expected to regularly present their project progress and turn in publishable technical reports, in order to pass the course. The lectures will be given in English. All the reports must be in English. 2. 指定用書(Text Books) - Students will search, print, read, and present the latest search papers under the guidance of the instructor. - Möller and Raake, Quality of Experience: Advanced Concepts, Applications and Methods, Springer, 2014. 3. 參考書籍(References) - Kurose and Rose, Computer Networking: A top-down Approach Featuring the Internet, Addison Wesley, 2016. - Schaar and Chou, Multimedia over IP and Wireless Networks: Compression, Networking, and Systems, Elsevier, 2007. - Li and Drew, Fundamentals of Multimedia, Pearson Education, 2004. - Steinmetz and Nahrstedt, Multimedia Systems, Springer, 2004. - Wang, Ostermann, Zhang, Video Processing and Communications, Prentice Hall, 2002. 4. 教學方式(Teaching Method) Each student will propose and carry out a research project. The expectation for each graduate student is to generate a research paper at the end of the semester. The expectation for each undergraduate student is to generate a report for a well-known multimedia grand challenge problem; or to produce a good system demo with demo abstract at the end of the semester. Students who do not deliver publishable reports at the end of the semester will receive failed grades. 5. 教學進度(Syllabus) The following tentative topics will be presented by the instructor, if not all students are familiar with them already. - Internet Architecture and Services - Audio/Video Coding Overview - Scalable Video Coding - Adaptive Multimedia Streaming - Stream Synchronization - Streaming to Wireless and Mobile Devices - Content-aware Multimedia Streaming and Storage - 3D Mobile Video The following is not an exhausted list of the latest research topic in multimedia networking: - 360-degree videos and head mounted displays (3DoF+ or 6DoF) - Multimedia Internet-of-Things - Media-Aware Network Elements - Virtual Reality and Augmented Reality - 3D Scene Reconstructions - Point Cloud Compression - Multimodal Speaker Recognition in Video Conferences - Decentralized Social Media 6. 成績考核(Evaluations) - Programming projects: 20% - Quizzes (10 times): 20% - Paper and book chapter presentation and discussion: 20% - Term paper: 40% Note that students who do not deliver publishable reports at the end of the semester will receive failed grades. 7. 可連結之網頁位址 https://volibear.cs.nthu.edu.tw/courses/

Timetable

Remarks

Restrictions

Compulsory

Elective

Cross Discipline

First Specialization

Second Specialization